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1. Prelude 

Programming is undergoing an extensive rethinking due 
primarily to the leadership of Dijkstra (1972). The effects of 
this change in our concept of programming will be to set it into 
perspective with other intellectual and problem-solving 
activities. In the course of such a revision of programming, we 
should keep a clear idea of the purpose of redefining 
‘programming: 


Programs must be understood by people. Only if we under- 
stand the programs will we know if they are correct, and 
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Fig. 1 Program to compute g(x) 


where they are applicable. And only if we know that the 
programs are correct can we be concerned about efficiency, 
because the most efficient incorrect program is ‘STOP’ 
which takes no time and no physical resources. 


We define the deep structure of a program as the description of | 
the underlying concepts in terms of which the program is 2 
understood. The deep structure and the methodology for = 
developing the program text are the aspects of structured 3 
programming which are considered most important. The @ 
syntax of the program text considered by itself is often 2 


: eae ; S 

an inaccurate indicator of program quality. Ss 
We shall give only the following example: 3 
Let = 
QO 

F={fiix>xt+.fg:x->x -— 1}* a 

and P = {p(x) <=> x is even}. F is a set of two functions, 3 
and P is a set of one predicate, all defined on N = {0, 1, 2,...}, O 
to be included in our mini language. The program to be®© 


written is to compute the function: 
i= 3ifx =0 
8) = O if x £0 
Clearly a program to compute g is shown in Fig. 1. On the 


other hand, suppose that our programming language, L, were 
restricted in the following way: 


(a)xeF=>xeL 
(6)x,yeF, peP=> 
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(c) L is the smallest set of programs defined by | and 2. 


Then L is composed of D-charts, and although g is program- 
mable in L nothing is gained by so doing. (Kosaraju (1974) has 
the most complete discussion of this issue, but see also Knuth 
(1974b), Ashcroft and Manna (1972), and the special 
SIGPLAN issue on control structures, Leavenworth (1972)). 
The point of the example is that a conceptual issue in con- 
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structing g from F and P is to understand how a test for 
evenness can be used to test for zero (when appropriate func- 
tions are available). Fig. 2 shows such a zero test in non-L form. 

In this paper we develop the deep structures of some programs 
in terms of the algebraic properties of the groupoids. Examples 
are given in which this point of view is then useful to program- 
mers who share this algebraic perspective in developing 
improved programs. 

We acknowledge the following who have influenced our 
approach to programming: Dijkstra (1972), Burstall (1969), 
Burstall and Landin (1969), Mills (1972), and Yelowitz (1973). 


2. Groupoids 

2.1. Algebraic prelude 

Dijkstra (1972) has posed the question, ‘In what sense can the 

following programs, (i) and (ii) be considered equivalent ?’ 
Let A; 1 <i <n be an array of truth-values and we wish to 

compute the conjunction of the A;’s: 


p= A A; 
i=1 


(i) condition — TRUE 
doi=1toN 
condition < condition A 4; 
end 


(ii) condition — TRUE 
while condition do i = | to N 
condition « condition A A; 
end 


Program (i) runs through the whole linear array, A, to compute 
p. Program (ii), however, makes use of an additional fact about 
the algebraic operation, A, namely that it has a zero. The 
important point is that Program (ii) can be understood as a 
variation of Program (i) which is applicable whenever the 
algebra has a zero. Let us review the relevant algebraic notions. 

An algebraic system, a = <A, 2) is composed of a set of 
elements A called the carrier of a and a set of operations, Q. 
A ranking function p assigns to each operation w in 2 a natural 
number, in {0, 1, 2,...}, called the rank of w. denoted p()). 
Each operation w in Q corresponds to a function w: A*™) > A, 
mapping the n-fold Cartesian product of the carrier to the 
carrier. Operations of rank 0 are constants, operations of rank 
1 are called unary, those of rank 2 are binary, those of rank 3 
are ternary, efc. 

A groupoid, G, is an algebraic system, G = <G, {0}» where 
@ is a binary operation. If G is finite, then @ can be specified by 
a groupoid operation table, where 0(g;, g;) is shown in the 
row of g,; and column of g;. (In infix notation 0(g;,g,;) Is 
denoted ¢;0g;). 


Example: 
Groupoid of logical values and a: 


G = <{TRUE, FALSE}, {a} . 
‘The operation table is: 
A TRUE FALSE 


TRUE | TRUE FALSE 
FALSE | FALSE FALSE 


An element x of a groupoid with operation @ is called a right 
identity if 0(y, x) = y for every y in the carrier; x is called a 
left identity if (x, y) = y for every y in the carrier. In the 
groupoid of logical values and ~, TRUE is both a left identity 
and a right identity. 


+A readable introduction for computer scientists is contained in 
Preparata and Yeh (1973). More advanced treatment is given in 
texts on Universal Algebra; for example, Gratzer (1968). 
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Fig. 2 Zero test in terms of evenness test 
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An element x of a groupoid with operation @ is called a right 2. 


zero if O(y, x) = x for every y in the carrier. x is called a left © 
zero if 0(x, vy) = x for every y in the carrier. In the groupoid ofS Oo 
logical values and ~, FALSE is both a left zero and a right 
zero. 

The following facts about groupoids are well-known: AS 
groupoid may have many left zeros or many right zeros. ButS 
if the groupoid has both a left zero and a right zero, then theS 
left zero and the right zero are the same, and there are no other 
left zeros or right zeros. £ 

Similarly a groupoid may have many left identities or many® 
right identities. But if the groupoid has both a left identity and= 
a right identity then the left identity and the right identity © 
are the same, and there are no other left identities or rights 
identities. 


‘sdy 


2.2. Evaluating a sequence over a groupoid 
Let (S,, S2,..., S,,) be a sequence of elements of the groupoid, . 
=(G, 0). The evaluation of the sequence over the groupoid & 
is the computation of (...(S,0S,)...60S,). The following 3 
programs are applicable: 


€/V/0C/e|9!We/[UlwW 


Program I—most general 


ve S, 

i-2 

while i < n do begin 
pees: 
ieit+l 
end 
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Program 2—the groupoid has a left identity 


ve | 

i<« ] 

while i < n do begin 
jones. 
ieit+l 

end 


Program 3—the groupoid has a left zero 


ve S, 

i 2 

while i < n and v # 0 do begin 
00S. 

iti+] 

end 
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Program 4— the groupoid has a left zero and a left identity 


ve | 

ie | 

while ; < n and v ¥ O do begin 
v<v86S; 

iceit] 


end 


Program 5—the groupoid has a left zero and a left identity and 
no zero divisors. 
ve | 
ice | 
while i < n do begin 
if S; = O then do begin 
v<«-O0 
exit 
end 
v<«vO0S; 
ie-it+l 
end 
Programs (1) and (11) of Section 2.1 can now be described as the 
evaluation of a sequence over the groupoid 


G = ({TRUE, FALSE}, {a }) . 


If S; 1 << nis the array of truth values, the most general 
program Is: 


(i) a) v~S, 
i-2 
while i < n do begin 
ve vAS; 
iis] 
end 


while recognition of both the presence of a left zero and left 
identity and no zero divisors allows the program to be written 
as: 
(ii) a) v~e | 
ie | 
while i < n do begin 
if S; = O then do begin 
v<«QO 
exit 
end 
ve vAS; 
i-it+ 1 
end 


Note 
If the groupoid may have zero divisors, then the test must be 
done on », as in program 4. 
Many more variations are possible if the groupoid is associ- 
ative or commutative, or other special properties arise, such as: 
ic ] 
while (i < n and S; = TRUE) 
iei+ 1 
end 
ve« S; 


which can be used for the iterative evaluation over the groupoid 
of truth values and a. 

The style of presentation adopted to facilitate the discussion 
emphasises the iterative control structure. No generality is lost 
in so doing. When the algebra is associative and commutative, 
as in the case of the minimax algorithm, set operations may be 
used rather than sequential iteration. 

Another style of presentation which ‘hides’ the counting from 
the programmer is a pseudo-LISP style. Any of the given 
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programs can readily be recast in that form (See e.g. Burge, 
1975). For example, program 4 of this section becomes: 


Program 4a 
ezaa = if null(x) 
then a 
else if head(a) = 0 
then 0 
else ez a 0 head(x) tail(x) 


3. Game trees 

3.1. Minimax prelude 

In two-person game playing situations (see Nilsson, 1971), it is 
common to represent the strategies available to the players as 
a game tree as in Fig. 3. 

The numbers on the leaves of the tree indicate the gain to A if 
the game is played in such a way as to arrive at that leaf. For 
example, at his initial move player A may choose a, 6 or c. 
If A chooses 5, then player B may choose to play g or A. If 
player B chooses g, then the gain to A will be four units. If 
player B chooses / then the gain to A will be two units. 

A strategy for playing this game which is widely used is the 
so-called minimax strategy. The assumption underlying this 5 
Strategy is that at each move player A will play to maximise his 2 
gain, and player B will play to minimise A’s gain, and each = 
player is aware of the other’s rule of play. 

A pair of recursive programs are readily written to compute 
the gain to A at a node. 

Let T be the rest of a game tree seen from any node in the tree. 
If the node is not a leaf then we may write 


peojumoq 


} 


T = 1(T,, To, .--» Te) 
where 7;, | < i < n, are the subtrees of 7 from left to right: 
T = lo 
T, T, eo ee e@ T,, 


The recursive programs are: 


max (T) A if 7 is-a-leaf then T 
else maximum {min (7,), ..., min (7,)} 


min (7) A if 7 is-a-leaf then T 
else minimum {max (7,), . . ., max (7,)} 

In writing these programs we have used a style of pseudo-PL/I 
and allowed operations maximum which selects the largest < 
element of a set, and minimum which selects the smallest 5 
element of a set. 2 
The fact that these programs could be written as a pair of > 
mutually recursive programs is because the evaluation of a © 
game tree corresponds to a bottom-up automaton evaluating © 
the tree. It is known that this form of tree evaluation is a 5 
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Fig. 3 A typical (?) game tree 
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Fig. 4 Part of a game tree illustrating af 


homomorphism from the tree algebra to the value algebra, as 
discussed in Levy (1976). Hence, this style of programming Is 
itself an illustration of the principle of incorporating the 
algebraic structure of the problem into the program. 

Alternatively, we might write the programs using the iterative 
control construct, do / = 2,...,n with binary operations [~ 
and |_, to compute the greater and smaller respectively of their 
operands. (Thus 5{°" 31s Sand 5 |_31is3). The iterative programs 
are: 


max (T) A if 7 is-a-leaf then return 7 
else begin value — min (7,) 


doi=2,....” 
value — value !~ min(7;) 
end 


return value end 


min (T) if 7 is-a-leaf then return T 
else begin value — min (7,) 


doi=2,...,.n 
value <— value [ max (7;) 
end 


return value end 


The groupoid structure in the evaluation of a node which is 
made explicit in the sequential version of the program using the 
iterative control construct is very important in the transformed 
version of this program discussed in the next section. 


3.2. Alpha-Beta (af) 

Consider the situation shown in Fig. 4. 

Once player B has evaluated the path labelled c, he need not 
consider further the path labelled d, since the value of the node 
at b cannot be more than 2—if it were player B he would 
evaluate the node as at most 2, since he always chooses the 
minimum—and since the root of the tree cannot have a value 
less than 4, since player A chooses the maximum, the subtree 
reached via d cannot have any effect on the value of the tree to 
A. Therefore, the subtree reached via d need not be evaluated. 

This is reminiscent of the situation we had encountered in 
Section 2, in evaluating a sequence over a groupoid with a zero. 
The value at the node 5 is the minimum of the values of its 
subtrees, evaluated from left to right, with the added condition 
that any value less than or equal to 4 is a zero of the groupoid. 
Summarising, the evaluation of the sequence of subtrees at a 
node is performed in a groupoid with a zero, the value of the 
zero being determined at the node. 

A special case occurs when evaluating the left-most subtree 
of a node, since the left-most subtree does not have a zero. 
It is usual in presentations of the alpha-beta algorithm to 
introduce fictitious zeros— + oo and — co—for this case. We feel 
that little is gained by this artifice, and that since such an 
artifice tends to conceal the algebra at the node it should be 
avoided. 

With this much introduction we can now present the 
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alpha-beta algorithm: 


max (7) A if 7 is-a-leaf then return 7 
else begin top — on (T,) 
do i = 2,. 
top <— top r 
end 
return top end 


min (T;, top) 


min (7) A if 7 is-a-leaf then return 7 
else begin bottom — max (7,) 


do / = 2,...,n 
bottom « bottom |_ max (7;, bottom) 
end 


return bottom end 


max (7, bottom) A if T 1s-a-leaf then return T 
else begin top < min (T,) 
do ij = 2,..., while (top < bottom) 
top + top [ min(7;,, top) 
end 
return top end 


min (7, top) A if T is-a-leaf then return 7 
else begin bottom <— max (7,) 
do / = 2,...,2 while (bottom > top) 
bottom < bottom |_ max (T;, bottom) 
end 
return bottom end 
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Note 
max (7, bottom) is the larger of max (7) and bottom while 
min (7, top) is the smaller of min(7) and top. In fact, the: 
situation is slightly more complicated since in max (7, bottom) 
for example, we are only interested in increasing the computed 
value of the subtree if it can effect the computed value of the: 
whole tree. (See Knuth, 1974b). 


4. Problems 

4.1. Backtracking 
The technique of enumeration known as backtracking iss 
discussed in Dijkstra (1972) and Nilsson (1971). However, the’ 
best introduction and discussion of backtracking i is still Golomt3 
and Baumert (1965). We can summarise the algorithm an 
follows. 

Arrange the set of alternatives as a decision tree. The set of 
leaves is called the frontier. Each path in the tree from root tor 
frontier corresponds to a sequence of choices. The set of: 
solutions in the tree is the set of paths which do not fail. 2 

An algorithm which does not use the zeros of the algebrae to” 
simplify the computation would calculate the set of paths fron 
a node x to the frontier, S,;, in the tree 


T: 
iin 
Ee Tae 


as Sy = U x*Sy,, where x is the label of the root. The set 
=1 
of slutions is then the subset of the set of paths which are 


successful, i.e. whose value is non-zero. 

However, the backtrack program uses the fact that if the 
value of an initial segment of the path from root to frontier is 
zero, then the value of the complete path must be zero. In the 
following programs we again identify the node of a tree with 
its label. The complete programs are: 


loz/etone/ul 


L 
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b A for ain A, do 
if not zero (a) then ba (a, a) 


ba(a, x) A if x is-a-leaf then print (a) 
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else doi = |,...,7 
if not zero (a*x;) then 
ba(a*x;, x;) 
end 
The procedure ba has parameters « and x, where x is a node 
label and « is the sequence of node labels encountered on a 
path from root node to x. 

Note that the backtrack program differs from the usual 
versions in that the backtracking, or reduction of the index k, 
is not explicitly shown. Thus the algebraically motivated 
backtrack program manages to ‘hide’ the stack control from 
the programmer—a feature that is desirable in recursive 
programming. 


4.2. The problem of the eight queens 

The eight queens problem is often used in the literature 
(Dijkstra, 1972) as a standard example of the application of 
backtracking. The problem is to find ways to place eight queens 
on a chessboard so that no queen is attacking any other queen. 
A brute force approach might examine the (°,*) possible 
positions in which eight queens can be placed. With the 
observation that at most one queen can be placed in a row, the 
search space can be narrowed to (8)® positions. We examine the 
(8)® positions by placing queens in rows I,...,/ and then 
attempting to place a queen in row / + 1, in the eight possible 
column positions of that row. When placement of a queen in 
row i + 1, column / is not allowed—because that square is 
under attack—the attempted partial solution, including 
(i + 1,/) will never lead to a valid solution. In the algebra of 
backtracking, that partial solution is a zero. 

We present first the abstract version of the eight queens 
problem followed by the program text of the B6700 ALGOL 
program. In these programs the following notations have been 
used: 


ga(k): queen has been placed in row k; 
if kK = 7 then write out the solution, otherwise 
attempt to place a queen in row k + 1. 

col[c]<=) column c is free 

up [vu] <=) upward diagonal uw is free 

down [d] <=) downward diagonal d is free 

Q[0...k]: placement of queens 0,...,k representing a 
partial solution 


The abstract program is: 
ga(k) Aif k = 7 then print QO 
else for i to 8 do 
if not zero(i) then 


Q[k + 1] := 
ga(k + 1) 
fi; 
for i to n do (Q[0] := 7; ga(0)) 


Note that the abstract program follows the general back- 
tracking pattern with k = 7 corresponding to a leaf of the 
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search tree. In the complete program tollowing,the zero test 
uses the three arrays, col, up, down, to check if the square 
being evaluated is under attack. 


The complete ALGOL 60 program is: 


begin 
file out (kind = printer); 
integer array QO[0:7]; 
boolean array co/ [0:7], up [—7:+7], down [0:14]; 
procedure ga(k); value 4; integer k; 
if kK = 7 then write(out, (8(x2, i2)>, Q) 
else begin integer c, u, d; 
c:= 0; 
u:=(k+1)- cc; 
d:=(kK+ 1+ 6; 
while c < = 7 do begin 
if col[c] and up[u] and down[d] 


then begin 
Q[k + 1] :=c: 
col{c] := up[u] := down[d] := FALSE; 
ga{k + 1); 
col{c] := up[u] := down[d] := TRUE; 
end 
end ga; 
integer c, /; 
j:=0; 


while 7 < = 7 do begin 
col[j] := TRUE; 


pa Sel 
end ; 
i:=0; 
while 7 < = 14 do begin 
upLy - — 7] := down{j] := TRUE; 
j:=*4+1 
end; 


cu 0; 
while c < = 7 do begin 
col[c] := up[—c] := down[c] := FALSE; 


Q[0] := c; 

qa(0]; 

col[c] := up[—c] := down{c] := TRUE; 
c:=*F¥+ 1 

end 


end. 
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5. Conclusion 
We have shown several examples tn which the algebra of are 
algorithm can be used to clarify a program text and its accom-. 
panying documentation. The programmer who knows the” 
relevant algebra will be better able to understand the programs? 
More, an understanding of the deep structure can lead te 
improved versions of programs in which properties of they 
underlying algebra can be exploited in the control structure of 
the program. 
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Book reviews 


Informal Introduction to Algol 68, by C. H. Lindsey and S. G. van der 
Meulen, 1977; 361 pages. (North Holland, for IFIP, US$14.50) 


ALGOL 60 appeared in 1960; the report was quite difficult reading 
to a generation not brought up on Backus Naur Form, but it became 
the users’ bible. A few errors were detected and a revised report 
appeared in 1962. ALGOL 68 appeared in 1968, by which time the 
whole scale of everything had increased. The difficulty of mastering 
the extended grammatical techniques used in defining it meant that 
few but specialists gave the report more than a single shuddering 
glance, and so in 1971 an official informal introduction appeared. 
As a result of the ‘field trials’ stage, a revised report appeared in 1974. 
This revision went further than the ALGOL 60 revision did; it made 
significant improvements in the language (as well as extensive addi- 
tions to the descriptive techniques). The 1971 introduction was no 
longer an accurate one, and the work here under review is its 
consequential revision. 

Every serious computer science undergraduate who uses ALGOL 
60 has his own (often Xeroxed) copy of the ALGOL 60 report. 
Because it carries the guarantee not only of the authors but also of 
the whole of IFIP WG 2.1, this work is nearly as authoritative as the 
Report itself. and might fulfil the same function for ALGOL 68 were 
it not far too big to do so. It starts with a sixty page ‘Very informal 
introduction’; one wonders whether authors and publishers have 
considered making this available by itself to penurious students. As a 
substitute for the report in this context its only defect, which it 
shares with the main work, is that it dispenses entirely with any 
formal grammar. | found it very clearly written. Apart from an 
unintended and distracting mnemonic in using fun rather than fn 
or func for function, and an unidiomatic usage of constantly (using 
constantly yielded for yielded . . . in the form of a constant), my only 
complaint is that I still, after considerable investigation of scope, 
range and reach, cannot see how a local generator in a for-loop can 
produce storage that outlives the control variable. (That the work goes 
too fast for anyone to absorb properly on a single reading is inevit- 
able.) The main work is directed to the specialist student, whether 
advanced programmer or implementer; it covers the whole language 
by a profusion of program snippets illustrating each point as it 
arises. Like the 1971 version, it is organised as a two-dimensional 
array of sections so that it may be read by rows (each introducing a 
new development of phrase structure) or by columns (each dealing 
with a new concept in data structure and its associated notation). 
The final row consists of more extendedexamples appropriate to each 
column. Appendices include a description of the sublanguage 
ALGOL 68S and of the recently approved stropping conventions. 

ALGOL 68 on the defensive is its own worst enemy, and some of 
this survives in this book. Thus although it is to be commended for 
restoring to us such familiar terms as expression and statement, it 
does its subject no good by suggesting that coercion saves us from 
writing widenedtoreal(i) when everyone knows that all it saves us 
from is float(). Nevertheless, these are minor criticisms. We have too 
often learned the hard way that, where the concealments and pro- 
tections of high level languages are concerned, ignorance is not always 
bliss. ALGOL 68 has chosen to develop a machine independent way 
of describing some of what goes on behind the scenes; just enough to 
restore the bliss without incurring the folly. Consequently this is a 
work that should be in every computer library, and that will be 
invaluable to anyone involved with a real understanding of what 
computing involves. 


B. HIGMAN (Lancaster) 
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Digital Picture Analysis, edited by A. Rosenfeld, 1976; 351 pages. 
(Springer-Verlag, Topics in Applied Physics, Vol. 11, US$29.60) 


Visual inspection as a routine task in industry, medicine and com- 
merce represents an enormous labour bill. This fact has fascinated 
computer scientists and engineers for several decades now and has 
spawned massive research efforts to automate these tasks with a, 
consequent vast literature. This book is a valuable source of refer- 2 
ences to that literature except for the singular omission of the 2 
substantial body of work on computer interpretation of images of 2 
three dimensional scenes. The five substantive chapters are separately & 
authored, and each treats a different topic area. There is an a 
(obligatory) account of character recognition by Professor Ullmann 3 
which is poorly illustrated and fails to give a sense of the challenges =: 
remaining in that field, e.g. recognition of badly written material like & 
signatures. A chapter by Haralick on the interpretation of images of > 
the land surface, e.g. air photos, does little more than parade the 3 
mathematics of decision theory: it gives us no sense of how well that e 
mathematics performs nor of what the state of the art is. Both S 
authors remain remote from the giver of the task. MclIlwain’s 2 
account of work in high energy physics—basically of the automatic 
analysis of bubble chamber photographs—is at the other extreme. S 
The physics underlying these images is well understood and the > 
recognition techniques are carefully tuned to the explicit recovery 3 = 
of the three dimensional geometry of the particle track..We are = 
presented with large amounts of high energy physics but no general =. 
principles of picture analysis emerge. Preston’s account of work on 2 
the analysis of cell images including work on chromosomes done in S 
the UK by Rutoviztz’s MRC group is a massive piece of scholarship, 
with more than 400 situations. 

The best chapter however is that written by Harlow and his < 
colleagues, in which they describe their work in devising compu- 
tational tools to accomplish automatic diagnosis of a variety of © 
clinical abnormalities—bone malformations, heart disease, brain = 
tumours, etc.—starting from conventional radiographs. The paper 
is full of interesting problem details, e.g. the ways in which congestion 5 
can occur in the heart—an important assessment in diagnosing ~ 
congenital heart disease. Estimating this from a radiograph involves S . 
‘seeing’ the heart boundary: a difficult problem made worse by the = 
fact that ‘there is some disagreement as to the location of the top of 5 
the heart, (so) we chose an arbitrary criterion suggested by radiolo- c 
gists’. The active collaboration between potential users—in this= 
case radiologists—and computer scientist produces something in 8 
which we can see how the problem interacts with the hoped for S 
means of its solution, namely the computing system. The collabor- 
ation also provides the opportunity to compare results: human v. 
computer interpretation—an evaluation all too often missing in the 
engineer’s sorties into applications. 

Perhaps the most interesting feature of their work however is the 
clear sense of the variety of processes that have to be programmed 
into an effect system. In his introduction the book’s editor Professor 
Rosenfeld offers a unifying framework for the subject in terms of four 
goals that he believes characterise pictorial pattern recognition— 
matching, classifying, segmenting and recognising. If such a taxo- 
nomy is to be useful, then it should inform the designer; while 
Haralick and Ullmann would, I’m sure, be happy with it Harlow 
and his colleagues seem to me to have felicitously indulged in what 
Preston in his chapter disparagingly refers to as ‘the adhockery’ of 
shape analysis. But shape and the meanings of shape is what it’s all 
about, isn’t it Professor Rosenfeld ? 
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